Question answering at the cross-language evaluation forum 2003–2010
Identifieur interne : 000067 ( Main/Exploration ); précédent : 000066; suivant : 000068Question answering at the cross-language evaluation forum 2003–2010
Auteurs : Anselmo Pe As [Espagne] ; Bernardo Magnini [Italie] ; Pamela Forner [Italie] ; Richard Sutcliffe [Irlande (pays)] ; Álvaro Rodrigo [Espagne] ; Danilo Giampiccolo [Italie]Source :
- Language Resources and Evaluation [ 1574-020X ] ; 2012-06-01.
English descriptors
- KwdEn :
Abstract
Abstract: The paper offers an overview of the key issues raised during the 8 years’ activity of the Multilingual Question Answering Track at the Cross Language Evaluation Forum (CLEF). The general aim of the track has been to test both monolingual and cross-language Question Answering (QA) systems that process queries and documents in several European languages, also drawing attention to a number of challenging issues for research in multilingual QA. The paper gives a brief description of how the task has evolved over the years and of the way in which the data sets have been created, presenting also a short summary of the different types of questions developed. The document collections adopted in the competitions are outlined as well, and data about participation is provided. Moreover, the main measures used to evaluate system performances are explained and an overall analysis of the results achieved is presented.
Url:
DOI: 10.1007/s10579-012-9177-0
Affiliations:
- Espagne, Irlande (pays), Italie
- Communauté de Madrid, Munster (Irlande)
- Limerick (Irlande), Madrid
- Université de Limerick
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000984
- to stream Istex, to step Curation: 000779
- to stream Istex, to step Checkpoint: 000032
- to stream Main, to step Merge: 000067
- to stream Main, to step Curation: 000067
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Question answering at the cross-language evaluation forum 2003–2010</title><author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name></author><author><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name></author><author><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name></author><author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></author><author><name sortKey="Rodrigo, Alvaro" sort="Rodrigo, Alvaro" uniqKey="Rodrigo A" first="Álvaro" last="Rodrigo">Álvaro Rodrigo</name></author><author><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:2558D47369DE491B5868983765EF17C53AD0A7D7</idno><date when="2012" year="2012">2012</date><idno type="doi">10.1007/s10579-012-9177-0</idno><idno type="url">https://api.istex.fr/ark:/67375/VQC-4QHRFPN5-B/fulltext.pdf</idno><idno type="wicri:Area/Istex/Corpus">000984</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">000984</idno><idno type="wicri:Area/Istex/Curation">000779</idno><idno type="wicri:Area/Istex/Checkpoint">000032</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000032</idno><idno type="wicri:doubleKey">1574-020X:2012:Pe As A:question:answering:at</idno><idno type="wicri:Area/Main/Merge">000067</idno><idno type="wicri:Area/Main/Curation">000067</idno><idno type="wicri:Area/Main/Exploration">000067</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Question answering at the cross-language evaluation forum 2003–2010</title><author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name><affiliation wicri:level="3"><country xml:lang="fr">Espagne</country><wicri:regionArea>NLP & IR Group, UNED, Madrid</wicri:regionArea><placeName><settlement type="city">Madrid</settlement><region nuts="2" type="region">Communauté de Madrid</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Espagne</country></affiliation></author><author><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name><affiliation wicri:level="1"><country xml:lang="fr">Italie</country><wicri:regionArea>Fondazione Bruno Kessler (FBK-irst), Trento</wicri:regionArea><wicri:noRegion>Trento</wicri:noRegion></affiliation><affiliation></affiliation></author><author><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><affiliation wicri:level="1"><country xml:lang="fr">Italie</country><wicri:regionArea>Center for the Evaluation of Language and Communication Technologies (CELCT), Trento</wicri:regionArea><wicri:noRegion>Trento</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Italie</country></affiliation></author><author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name><affiliation wicri:level="4"><country xml:lang="fr">Irlande (pays)</country><wicri:regionArea>University of Limerick, Limerick</wicri:regionArea><orgName type="university">Université de Limerick</orgName><placeName><settlement type="city">Limerick (Irlande)</settlement><region type="région" nuts="2">Munster (Irlande)</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Irlande (pays)</country></affiliation></author><author><name sortKey="Rodrigo, Alvaro" sort="Rodrigo, Alvaro" uniqKey="Rodrigo A" first="Álvaro" last="Rodrigo">Álvaro Rodrigo</name><affiliation wicri:level="3"><country xml:lang="fr">Espagne</country><wicri:regionArea>NLP & IR Group, UNED, Madrid</wicri:regionArea><placeName><settlement type="city">Madrid</settlement><region nuts="2" type="region">Communauté de Madrid</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Espagne</country></affiliation></author><author><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name><affiliation wicri:level="1"><country xml:lang="fr">Italie</country><wicri:regionArea>Center for the Evaluation of Language and Communication Technologies (CELCT), Trento</wicri:regionArea><wicri:noRegion>Trento</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Italie</country></affiliation></author></analytic><monogr></monogr><series><title level="j">Language Resources and Evaluation</title><title level="j" type="abbrev">Lang Resources & Evaluation</title><idno type="ISSN">1574-020X</idno><idno type="eISSN">1574-0218</idno><imprint><publisher>Springer Netherlands</publisher><pubPlace>Dordrecht</pubPlace><date type="published" when="2012-06-01">2012-06-01</date><biblScope unit="volume">46</biblScope><biblScope unit="issue">2</biblScope><biblScope unit="page" from="177">177</biblScope><biblScope unit="page" to="217">217</biblScope></imprint><idno type="ISSN">1574-020X</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">1574-020X</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>CLEF</term><term>Evaluation</term><term>Question answering</term></keywords></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: The paper offers an overview of the key issues raised during the 8 years’ activity of the Multilingual Question Answering Track at the Cross Language Evaluation Forum (CLEF). The general aim of the track has been to test both monolingual and cross-language Question Answering (QA) systems that process queries and documents in several European languages, also drawing attention to a number of challenging issues for research in multilingual QA. The paper gives a brief description of how the task has evolved over the years and of the way in which the data sets have been created, presenting also a short summary of the different types of questions developed. The document collections adopted in the competitions are outlined as well, and data about participation is provided. Moreover, the main measures used to evaluate system performances are explained and an overall analysis of the results achieved is presented.</div></front></TEI><affiliations><list><country><li>Espagne</li><li>Irlande (pays)</li><li>Italie</li></country><region><li>Communauté de Madrid</li><li>Munster (Irlande)</li></region><settlement><li>Limerick (Irlande)</li><li>Madrid</li></settlement><orgName><li>Université de Limerick</li></orgName></list><tree><country name="Espagne"><region name="Communauté de Madrid"><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name></region><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name><name sortKey="Rodrigo, Alvaro" sort="Rodrigo, Alvaro" uniqKey="Rodrigo A" first="Álvaro" last="Rodrigo">Álvaro Rodrigo</name><name sortKey="Rodrigo, Alvaro" sort="Rodrigo, Alvaro" uniqKey="Rodrigo A" first="Álvaro" last="Rodrigo">Álvaro Rodrigo</name></country><country name="Italie"><noRegion><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name></noRegion><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name></country><country name="Irlande (pays)"><region name="Munster (Irlande)"><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></region><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Informatique/explor/SgmlV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000067 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000067 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Informatique
|area= SgmlV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:2558D47369DE491B5868983765EF17C53AD0A7D7
|texte= Question answering at the cross-language evaluation forum 2003–2010
}}
| This area was generated with Dilib version V0.6.33. |  |